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ABSTRACT 

Described are the development of "Findings Kids with 
Special Needs" (FKSN) , a instrument to identify children's learning 
problems and gifted students; results of field testing with 24,825 
children, kindergarten through grade 8, in 110 schools; and 
validation procedures. Discussed is test construction, including 
incorporation of 12 criteria such as low use of teacher time, and 39 
vignettes (developed by 19 special educators) which describe 18 
subcategories of need that can be grouped into the 10 major 
handicapping areas. The following is an example of a vignette: "Jane 
can read material which is about five grade levels above her class, 
however, her handwriting is poor and she is about average-to-above in 
most other subjects". Results of field testing in five midwestern 
states are given to show that 6,448 children had one or more areas of 
special need, that there were a total of 10,351 combined special 
needs (9% were severe) , and that 993 teachers spent a minimum of 25 
and a maximum of 55 minutes per class checking vignettes against 
observed student behaviors. School personnel requests for 
confidentiality are said to have been honored in computer assisted 
development of a student profile, building profile, and a master list 
of students for local school use. Discussed are results of validation 
procedures such as studies involving 24 special school children and 
2»151 regulcir class children which show that the FKSN accurately 
i'ientifies school children with learning problems. The FKSN is 
r<5Commended to fill the gap between children already referred and 
cnildren in need of special services, and to free special education 
5:taff from psychometric duties for more support to regular class 
teachers, (MC) 
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Once identified, still anotner frustration has to be 
faced — how to get services to the kids referred. This pro- 
blem is accentuated by budget constraints on the number of 
psychologists, speech therapist*;, audiologists, counselors 
and other specialists which a district can hire to diagnor>e, 
to develop treatment stategies, and to impleirent remediation 
for the children referred. 

As we look closer at thi? situation, we find th^t it 
is not uncommon for o teacher to wait from three weeks to 
several months before a psychologist, etc. can schedule a 
diagnostic session for a referred child. Even then, the 
specialist is only able to see the child under conditions 
which are often different from those which precipitated the 
child's behavior in the first place. Further, if the child 
is absent the day scheduled, he may have to wait several more 
weeks for the psychologist's return visit. 

One cannot fault the specialists for this delay. The 
number of cases referred to them may exceed all p^. ssibil i t i es 
of doing a thorough diagnosis on each referred child, let 
alone help implement a treatment strategy. 

It is easy to see, therefore, that teacher hesitation, 
budget priorities and diagnostic scheduling work hand-in-hand 
to limit the possibility that appropriate services will reach 
a child in time to be of most help. As the system now works, 
a kid has to make his wheel squeak pretty loud before he gets 
assistance. Even then, much of that "help" is diagnostic 
not treatment. The specialist confirms what the teacher often 
already knows, but she and the child are still a long way from 
knowing what to do about the learning problems. 



R. LEGISLATIVE, LEGAL., AND PARENTAL PRESSURES: 

Since a large number of our kids graduate or drop out of 
i.chooX without being able to adequately read or do simple math 
problems, there are growing efforts to up-grade our educational 
system. Legislative mandates for public schools to provide 
s'^rvices to the retarded, LD and ED children are now law in 35 
s ates. As a further example, during 1971 alone, nearly 1,000 
bills were introduced in state legislatures involving the ed- 
ucation of the handicapped. Similar activity is going on in 
the Congress. 

Also at the Federal level, the HEW Bureau of Education for 
the Handicapped has taken the leadership to establish long-range 
identification and service goals. For instance, the National 
Advisory Committee on Handicapped Children issued A Call To Action 
on April 16, 1973. In their request they state that, "No handi- 
cap]>ed child should be asked to wait for services. Their future 
is riow. Education for the handicapped today means a full life 
with economic, social, and moral self-sufficiency." The NACHC 
Q ; on to recommend as one of their long term goals, the "un- 
- - "2d testing, assessment and identification" of the handicapped. ^4 
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FKSN FEEDBACK TIME 



Walt: 



-Let's set a time to discuss ways of using FKSN to screen our area 
My calendar is open the dates j ^ jft ^ so 9iv< 

ne a call. 

•I am interested in districtQ, interraediateQ, and/or state 
level screening. 



-Please send me copies of your screening instruiaent to review 
with our staff. 



The following people should also receive a copy of your report « 

Naiwe., Address 



Namft. 



Address. 



CtMMits pro or cas: 



Nmo. 



r^sitloo 



Addross . 



lip 



Pfcom{ L 
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The coLirls, Loo, hnvo joined the Ccil.l for action with 
landmark decisions .in Alabnma, Pennsylvania, and Washington 
D-C. ■ Theyse judgments maintain that public schools must pro- 
vide, under the 14th Amendment's equal protection clause, 
a ppropritj t e educational services for all children not just 
the "norm". 31 

Children may not be excluded from school. Further, dis- 
tricts and states may not use budget limitations as a reason 
for noncompliance. To support their decision, the judges in 
the Alabama case ordered the State to sell some of its land 
to help pay the increased cost of supplying services. 

Similar cases are now pending in California, Delaware, 
Massachusetts, Michigan, and North Carolina. Also, the' ruling 
in Serrano vs. Priest seems quite consistent with these court 
actions. 

As for parental input, the effective lobbying of the Coun- 
cil for Exceptional Children and its many related organizations 
is being increasingly felt by legislators, judges and educational 
administrators. For instance, on the East Coast The Pennsylvania 
Association for Retarded Children^ Inc. took direct action by 
starting its Pennsylvania Childhunt to locate some 50,000 retarded 
kids who had been denied a free public education. 

Governor Milton J. Shapp issued the following statement 
on October 8, 1971, in support of this effort: 

In this consent agreement which the Federal 
Judges accepted. .we spell out how state law will 
be administered to implement the section of the 
Pennsylvania Constitution which guarantees every 
child in the Commonwealth the right to a free public 
education. The agreement recognizes the state's 
responsibility to uphold the doctrine that every 
child can benefit from an educational program and 
that where feasible, this program should begin at 
a preschool age.^^ 

Much praise should be given to the valiant and determined 
efforts of these parent organizations. For years, they have 
been leading the fight and footing the bill to get their kids 
an education. Paying property and state taxes plus paying 
for private school instruction has meant double taxation for 
many parents . However , t he realignment of public school re- 
sources and early identification programs should now ease 
this burden. 



C. THE FiNANClAL DILEMMA: 

One result of these legislative, legal and parental activi- 
ties, might be that the financial strain on school districts and 
state budgets is going to increase. Obviously, finding and pro- 
Y yiding services for more educationally handicapped kids is no 
£^RJ(^vay to stay in the black. 
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Let ' s take a closer look at this dilemma. Through such 
extensive studies as the iNational Educational Finance Project 
(NEFP) it is clear that current policy and instructional methods 
cost districts more per child to educate the handicapped than 
other groups of children. For example, using an index of 1.00 
for the cost of educating an elementary school child (grades 
:^-6), Dr. Johns and his team suggest that the "weighted pupil'^ 
index for a mentally handicapped child is 1.90,, for physically 
handicapped children it is 3.25 and for children with special 
learning disorders, the index is 2.40. Therefore, if a district 
is already feeling the financial pinch, it may take considerable 
incentive for it to try to identify more kids in its classrooms 
and community to which services should be provided. 

A number of districts have obviously faced this dilemma. 
They reali;;e that some kids need more services than others 
and that their referral lists are incomplete. They also re- 
alize that a phased approach to providing these services is 
economically and educationally sound. However, the only way 
they have had of planning ahead for the needs of educationally 
handicapped kids is through the use of the "national incidence 
figures". 

0. NATIONAL INCIDENCE FIGURES AND INDICES i 

Many a federal grant arid legislative proposal has based 
its budgets on these figures. Unfortunately, national averages 
have all the problems of any measure of central tendency. 
They (1) do not show the wide differences between schools with- 
in a district nor (2) do they show the va st . differences between 
districts within a state. Also, there is evidence to indicate 
that these averages generally underestimate the number of kids 
needing services in any district. 

Therefore, in view of the NEFP findings, financing patterns, 
and low estimates, it costs some districts much more than their 
state foundation plan permits to adequately provide services 
to the kids who need them. This leaves districts with the choice 
of providing the services, while hoping for reimbursement so 
■ they don't go in the red, or ignoring the needs of the kids. 
The latter decision is unfortunately made much too often. 

One approach which does not use national incidence figures 
has been suggested by Dr. Bill Wilken from Georgia State Uni- 
versity, His computer simulations attempt to equalize edu- 
cational financing within states by using the total number 
of Title I kids in a district and providing more money in the 
state formula for their education. 

Here again, the financing is clouded. In the Johns 
NEF project, "weighted pupil" indices for an unknown population 
are used. On the other hand,- the Wilken formula uses a body 
count arrived at with criteria which are economic rather than 
educational. 
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Until an adequate procedure is developed to assess the 
extent of educational needs within districts, these efforts 
to equalize educational opportunity through more equitable 
funding will be unsatisfactory^. Also, neither the national 
incidence figures nor the s/ohns or Wilken approach actually 
identifies specific childrcro? i^ssesses their potential needs 
and then assigns some measure of the potential costs associated 
with providing them with appropriate services. (The NEFP 
indices come closest to potential costs but even here, the 
latitude for program planning is very limited by their use 
of fixed values and broad categories.) 

T t boi Is dpwn to the fac t that a di strict or state 
cannot . provi de services to' a number a "guesstimate*'. Kids 
are the recipients of our educational resources, and services 
cannot be provided for them unless we know who they are in 
time to do something about their needs. Legislative mandates, 
court decisions, and parental lobbying will have little effect 
until a comprehensive screening procedure is used. 

E. INITIAL LARGE-SCALE IDENTIFICATION EFFORTS \ 

Krom tne rederai level on doivn , there have beeh l*ti\?bht 
efforts to implement identification programs. Ho\VoVer, i liese 
activities have met with limited success- 
Pennsylvania's '^Childhunt^' is only on^ of many i^\\c\\ 'f I'o r t s ; 
Other examples include the Study of Handle:.^ \3l3ed Chi-1'dre'n and 
Youth which was conducted during 1970-71 by the ^ljchigan De- 
partment o f Educa tion . 

As State Superintendent Porter wrote in lii s foreword to 
the report , 

Th e first pu r po s e of thi s study is to p r o vi.dtia 
the Michigan Legislature with information tV)lVc"e^Hi)i<^ 
the number and type of handic^^ppod children and yoUth 
in Michigan and the services Currently bolhg provi dc^ 
for them. He further stated that the second purpos^i 
is to insure that local srhtVy^ districts have the 
opportunity to assess the ^cU\\^a tiona 1 needs of their 
handicapped children and to di^yelop educational jpians 
to meet the needs of these children in their own 
communities. 

Similar state- wide ef£bl"t^ h^v'e been attempted by Nebraska 
with its Nebraska Handicap ithformation System and by South 
Dakota. 23 In Utah tecichers weto nsked to write down the names 
of the retarded, emotional ly clj&tUrbed, speech impaired, etc'. 
children in their classxoorn* Nlississippi has also used similar 
techniques in the area of the mentally retarded- 

In some instances, multiple districts have hired teams 
of psychologists to screen fpi: the educationally handicapped. 
One such five-district prdje^i^ in Missouri hired a team of 
psychologists and support sl^f if Vd .screen all of the enrolled 
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second graders lof iGc'^rnlng disorders. They wore not looking 
for any other category of need nor at any other grade level , 
Some $180,000 was spent for the first year of the project. Also, 
treatment for the identified second graders was not intended 
to stevrt until the f ol lowi ng. year . 

F. PROBLEMS: 

As it turns uut, many of the state lev^ei identification 
projects mentioned have been plagued with problems. For the 
most part, their results include only those kids who have 
filtered through the school referral system or have been col- 
lected on public schdcii, Health Department or social ^ service 
li.sts. They also retlect only that data which the otlier agencies 
would share with the Department of Education, The Michigan 
study, for example, reported numerous instances where inter- 
agency cooperation was very lacking* 

It becomes a situation where in order to be referred, a 
child's behavior has to be quite outstanding^ and oven then 
he is not assured of being part of the information used for 
long-range planning and budgeting. Consequently, most of these 
efforts to CO ibine lists have unfortunately had more to do with 
politics and policy than with the actual number of kids needing 
services. 



As for the efforts to get teachers to label the kids in 
their classroom, there is justified concern over prejudicing 
the teacher's judgment about a child. Secondly, each teacher 
has a different set of criteria about what a mentally retarded 
child actually is. Therefore, the results from these methods 
may be questionable at best and may end up doing more harm 
than good. 

On the other hand, screening projects like the one in 
Missouri, where psychologi st s were hired, required massive 
amounts of time, money and patience to screen a limited segment 
of the school-age population. It seems that other procedures 
. might be more comprehensive and- less expensive. 

6. SCREENING INSTRUMENTS: 

Whether the financial dilemma plus the problems with 
estimates and lists continue to deny services to kids depends 
a lot on (1) whether a more systematic method is found to 
identify kids before their learning problems become £0 costly, 
and (2) whether procedures are worked out to more efficiently 
use the diverse resources presently available to a district. 

In an effort to reduce the effect of some of these pro- 
blems, numerous screening instruments have been designed and 
tested over the past few years. They do not rely on the re- 
ferral system or worse yet, on an accounting of the number of 
lo.ds in reimbursed programs (a practice which reflects more 
Y^r^jr^'^^ ^ district's ability to set up and pay for such programs 
|;^RI(^i it does about the number of kids needing these services). 
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Moi^t or Lht^se instruments ore, however, limited to only 
one category (jt disability, i.e. only speech or only the emo- 
tionally disturbed. (A listing of many of these screening 
instruments is supplied in Appendix A.) Therefore, they do 
not provide a comprehensive profile of the multiple areas 
of need which an individual child may have nor do they provide 
a total picture of all the potential learning problems with- 
in a given classroom, school, or district. 

Another problem which some of these instruments have is 
their reliance on the child* s test-taking ability. Therefore, 
if a child is not up for taking the screening test, he may 
fall out as a i'alse positive in the data. 

One very encouraging note from these early efforts is 
the fact that those instruments which derive their results 
from the teacher's observation of her children, eliminate the 
variable of the child's test-taking behavior. More importantly, 
teacher ratings seem to have the highest correlation with future 
achievement scores (Keogh, & Smith, ig70), (Henig, 1949) and 
(rio, Ames Apell, 1965), and actual behaviors (Harth & Glavin, 
1971). 

H. EARLY IDENTIFICATION SYSTEM CRITERIA : 

[t appears then, that to be truly effective, screening 
procedures on a building, district or state level will have 
to meet the following criteria: 

1) The procedure must be able to screen all school 

aged kids the earlier the better ... .K-6 at 

least if not K-12. 

2) It Mst provide a comprehensive profile of each 
child's potential needs - not just those in a 
given category. 

3 ) it must not u se large amounts of teacher time. 

4) It should free specialists to use their needed 
skills for more than psychometry. 

5) It should not force teachers to label the kids they 
teach . 

6) It should not rely on referral lists, national inci- 
dence figures or indices, but rather on the actual 
school population being screened. 

7) It should be inexpensive to administer, analyze and 
report . 

8) It should be as accurate as possible but not meant 
to be an indepth diagnosis. Such testing, if needed, 
can be provided as a part of follow-up servicos. 




c) ) Larop [X ) |)u K-i I i ons shcjuld bo t?a si 1 y scrooned with 

[iiinir"al tl i s nipt i on the? classrtKini and districts* 

10) The results should be repi^riod in a rnrmat which 

is easily usod and directly applicablt-? to p.L'mning, 
budaotinq and lonisLative of torts, 

11) The? profiles and numonc 1 a turt* sht)uld bu consistcMit 
with current practices, Subca tenor i es of nocd shoiilci 
bo able to be combincKl if plt-mninq I'or similar nr(iups 
is dcisirod. Ilowovor, whero significant differonces 
exist in the diaqnustic and treatment resources, the 
subcategories should be able to be isolated and 

pi anned for separat ely , 

12) The results should be easily updated, I^eierral lists 
fr()m the district and community should be able to be 
added without duplicating the same child's needs and 
thereby inTlatinrj the figures, 

DEVELOPMENT 

Tht? ciosign for "Finding Kids with Special Needs" is modeled 
after the vignette approach used by Dr , George Stern in his 
Classroom Integraticjn Inventory ^ and Drs, Chauncy Rucker and 
Kobert Gabl<> in their Educational P r o q r a mm i n n S c a 1 e ~ 4 . ^ Both 
of these instruments were designed to assess'the attituaes of 
teachers t<.>ivard handicapped children, and to gather group 
data (in the program of services which the teachers would re- 
commend I'or each behavior described. 

The use of vignettes has several advantages. First, it 
does not force teachers to label children, Sec<.)ndlyj rather 
than each teacher using his or her ov\ti criteria, vignettes 
provide standards jied descriptions of observable behavior which 
can be validated by experts prior tf) being used t,o gather data. 
They also permit data to be quickly gathered from teachers 
rather than having to take the time and expense to send outside 
observers to every classroom to evaluate each child. 

It mi^st be mentioned, however, that neither of these in- 
struments was designed to screen kids for possible learning 
problems. They were only meant to assess teacher attitudes and 
help with program planning. 

So that data could be gathered by FKSN on individual child- 
ren and then grouped by classroom, school and district, 75 vig- 
nettes from the Sterns instrument were modified. All references 
to age or grade in school were removed. Also, vignettes in the 
retarded and SI^D areas were added. 
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A, CONTENT VALIDITY'^ 

These vignettos were then rjiven to 19 experts in special 
education. Each of those experts works with the educaxioncilly 
handicapped and regular classroom teachers. Five consult for 
a State Department of Special llducation, nine work with kids 
in a Joint County School System and tivo work with teachers 
and kids as part a federal project. 

The specialists independently rated the modified vignettes 
along two parameters: (1) the category of behavior described 
by each vignette, and (2) the level of severity (mild or severe) 
represented by the behavior. Each vignette covered only one of 
the following areas of special need: (1) vision, (2) hearing, 
(3) retardation, (4) gifted, (5) learning disabled, (0) emo- 
tionally disturbed, (7) motor and other health problems, 
(8) speech, (9) reading and (10) math. The mild and severe 
subcategories were assigned to areas 1-8. 

The 30 vignettes which had rater agreement of 75To or more 
were then chosen to describe the 18 subcategories of need. For 
thcjse are;is which may be described by several different behaviors, 
such as mild ED, mild motor or severe speech, four vignettes 
were selected. The other subcategories were represented by two 
behavioral descriptions. (Examples of some of these vignettes 
are listed in Appendix B. ) 

B. CONSTRUCTION: 

Once the validated vignettes were randomly mixed through- 
out the instrument and numbered, a computer program was written 
to match each description to the category assigned by the sr»-oial- 
ists. Instructions and examples for the teachers were al^^ 
written and tested by impartial judges.. 

From the beginning, careful attention was given to the 
broad range of behaviors which may be causing learning problems 
for a child. Therefore, rather than being seen as just ED or 
in need of speech correction, a child may show up in both areas. 
This type of reporting also eliminates inflated counts which 
may actually be only a small number of kids whose names are 
duplicated on multiple lists. 

If grouped data are needed, the 18 subcategories may be 
collapsed into the ten major areas of need or even reduced further 
to look at multiple handicapped groupings. This flexibility 
was purposefully built in for later administrative and planning 
use. 

Further, by using both mild and severe levels of need, 
the screening results give psychologists and administrators a 
good indication as to the amount and type of resources needed 
, for an individual child or groups of kids in a classroom, build- 
Q ng or district. 
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AS a final point; it is important to note that this breadth 
was also desigi\od 1 >» find kids rather than exclude them. There- 
fore, marginal rr,<^Qs, are identified before they become major pro- 
blems. In surl) instances, the needs of these kids may then be 

handled by limited diagnostic and treatment follow-up, leaving.. 

more timr for specialists to work with those kids who have more 
severe learning problems. 



During February of 1973, the State Directors of Special 
Education in five midwestern states were contacted to request 
their cooperation in field testing FKSN. Schools were then 
selected from urban, suburban and rural districts as well as 
from a multi-county school system. Where multiple districts 
were involved, both the county and local school superintendents 
were contacted to seek approval for the pilot testing. For 
single district testing, it was the local superintendent who 
gave the go-ahead. 

Excel liDnt cooperation was received from all personnel at 
each level. For local coordination, however, the main channel 
of communication was through each district's Director of Special 
Education. They kept the building principals informed and through 
their special education consultants, handlt.d much of the informal 
communication necessary for a project of this scope. 



During April 1973> screening instruments were sent to each 
coordinating Director. They, in turn, distributed the appropriate 
number of instruments to each building principal who passed them 
out to the teachers, 

FKSN was easy for the teachexs to complete. They just read 
each vignette and wrote down the names of any children in their 
classroom who had behavioial patterns similar to those described. 
Along with each name they wrote, they also included a code to 
indicate whether this child had been previously diagnosed, whether 
the child needed immediate attention and/or whether present services 
were felt to be adequate. 

If the teachers did not have any kids like those in the 
vignettes, they moved to the next description. On the other hand, 
if a specific child's learning problems were not described by 
any vignette, then the teacher wrote this child's name on the 
back of the response sheet and described the problems. 

The same child's name may appear on a teacher's list ten 
times but the computer program groups these responses under the 
appropriate area of need. However, since most of the teachers' 
data sheets only listed an average of seven children, writing 
was minimal and reading time was also short. 




A, PUBLIC RELATIONS • 



B. DATA COLLECTION: 
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Onco c'oinpl i'tod, t fu? principal collGcted the answer sheets 
p.nd returned tlu?m t<' the coordina t i no Special Education Director. 
District and multi-district ciatn were then batched and sent tor 
ana lysi s . 

In all, instruments were sent to 131 schools. A total of 
110 schools returned data sheets i"or an 84% return rate. As a 
result or this field tost, over 24,825 K-8 kids were screened 
by 993 teachers. From this population, 6,448 children were 
identified as havinn one or more areas of special need. A summary 
of these data is provided in Table 1. 

C, PROCESS FEASIBILITY 

Special attention was paid not only to field testing the 
instrument but also to the process of data collection. To assess 
the feasibility of district or multi-district wide screening, 
the channels of communication and data handling had to be checked. 
Careful analysis in a nine district special education cooperative 
in Kansas and a six county, 37 district school system in Iowa, 
indicates that rr>inimal disruption occurred in the buildings, 
existing lines of communication took care of most questions, and 
anxiety was very low. Of equal importance is the fact that the 
data came back with a minimal number of reminders, in usable 
form, and in time to be analy;;ed. 

From a sample of 36 of thp 993 teachers, it was found that 
the process took 67^5 of the teachers 25 minutes or less to read 
the instructions and screen all of the children in their class- 
room. The most time indicated by any teacher was 55 minutes. 
The instructions were clear for 95% of these teachers. This 
finding is verified by the excellent quality of the raw data re- 
turned. Any variance from the expected responses was not sig- 
nificant enough t > cause any teacher* s data sheet to be unusable. 

D. CONFIDENTIALITY: 

Since some classroom teachers, principals and superintendents 
asked that the childrens* names be kept confidential, the data 
collection was set up to accommodate this justifiable concern. 
Once again, the purpose of the screening, as seen by the districts 
and the developer was not to generate lists of names for broad 
dissemination,. On the contrary, it was to identify the learning 
problems of specific kids so that district personnel could more 
effectively administer local, state and federal funds. This means 
getting services to the kids as soon after their needs are iden- 
tified as possible. 

With this child-oriented goal in mind, a procedure was 
developed to make it possible for a secretary at the local district 
level to code each of the names on the data sheets supplied by 
the teachers. Any questions arising from a teacher* s responses 
were interpreted and coded by a specialist. The numerical data 
wa s then sent on for compu t er ana lysi s . Thi s approach per mi t s 
the results to be based on actual kids in actual clasisrooms while 
assuring local control and confidentiality of the names of the 
teachers ar.d the kids they identified. 
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The computer analysis and printout gave the local Director 
of Special Education, tlie building principal and specialists the 
code necessary to match the screening proi'iles with each name 
on the data sheets they retained. When responsibility for special 
services was assigned at the multi-district level, then that was 
the level where the names were retained. For example, this is 
how data were handled for the six county school system. 

The point is that FKSN has been designed and tested to 
provide maximum flexibility and confidentiality. However, these 
features should in no way limit the usefulness of the results for 
state-wide planning. In fact, they should make such screening 
and planning even more feasible because local districts are 
more willing to cooperate when they have control of potentially 
sensitive information. 



E. OUTPUT FORMATS: 

i. STUDENT a BUILDING PROFILES 

Three basic output formats were developed. Prime emphasis 
was placed on making them simple to . read, complete and accurate. 
Many "canned programs" were reviewed but none satisfied these 
criteria. 

The computer program written for these analyses provides 
the output shoivn in Table 2 and Table 3. You will notice that 
the teachers' names are coded under the classroom heading. The 
children's names are also coded. 
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The "SN" number beside each area of exceptionality in a 
child's profile stands for "Special Need". This code contains 
additional information which the teachers supply about this 
specific behavior for this individual child. For example, a 
#3 indicates that this behavior has been diagnosed by another 
professional , i .e» a physician, psychologist , speech therapist , 
etc. A #2 indicates that the child needs special attention 
soon. A #7 indicates that the behavior is frequent, has been 
diagnosed and that special services were needed yesterday. 

This SN feature obviously gives planners a starting point 
in deciding service priorities. The severity of the behavior 
(mild or severe) also gives an indication of the amount and type 
of resources needed by the child. 

In addition to the teacher code, student code, learning 
problem areas, level of severity and SN number, the data are 
summarized for each building. This summary is provided two 
different ways. First, the number of kids identified in a 
building is totaled. at the bottom of the student profile output. 
Secondly, the areas of need in each classroom are totaled by 
classroom and by category. Since some kids obviously have more 
than one potential learning problem, this means that the total 
O /or the building profile is greater than the number of kids 



identified. 
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2. THE MASTER L/3T 

The third output format is a master list which provides 
great flexibility for planning at the local level. More impor- 
tantly, it provides an excellent way to see that follow-up ser- 
vices are provided to each child identified. It also eliminates 
the duplication of names for any child who is in two or more class- 
rooms such as departmentalized 5th and 6th grades or unit struc- 
tured buildings. 

The master list may be an alphabetical listing of all kids 
identified in a specific school, or it may be all the kids alpha- 
betized by district or grade level, or area of special need, 
etc . 

By a ssigning the follow-up services for a given child to 
a specific employee, the educational administration at whatever 
level of responsibility, be it building, district or multi- 
district, can monitor the progress of any additional diagnosis, 
treatment, evaluation, placement, etc, for that child. If it is 
decided that inservice training for specific classroom teachers 
is the most cost-effective way to get special services to a larger 
number of kids xvith similar problems, then the names of these 
teachers and kids can be grouped by the computer and printed. 
Once the training is provided, an assessment can be made later 
to find out if the children are in fact improving. 

Such a master list was developed for the six county system 
in Iowa. Computer cards were punched for each of 3,014 kids. 
The cards were then sorted by the computer to provide an alpha- 
betized listing. Table 4 shows how these same cards can be 
rearranged to provide a listing by grade level and area of need. 

The first 14 digits contain a school, teacher and student 
code which permits the information on the card to be updated as 
services are provided. Sorts can also be run on these numbers to 
profile a county, a district, specific schools or specific class- 
rooms . 

In this example, student names have been removed to assure 
confidentiality. The codes following each student's name refer 
to specific areas of need, level of severity and SN number. These 
data are then followed by the teacher* s name and grade level. 
Extra space is provided on the computer card format for additional 
data as needed. 
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TABLE 4. MASTER LIST 



SCHOOL CODE 


STUDENTS IDENTIHED 


NEEDS CODE 


TEACHER 


GRACE 


57477704270501 
571 08904090701 
48702904270801 
92676804030602 
523 I 4 104 I 10913 
57371504271404 
483 1540409 1205 
571 06204090402 
06060904 180203 
52609304091401 
-^74 7770^090104 




2M37M 4M3 
2M34M35M3 
2M34M 5M0 
2M04M 6M0 
OMOlM 7M0 
2M34M77M3 
3G35M27S0 
2M04M 8M0 
2M04M38M3 1 
2M74M38MO ! 


FI SHER 

GUSTOFF 

K I RKPATR I C 

MARIE 

REYNOLDS 

5TEFFES A. 

L ARSON 

CA5TEK 

'='£RREE 

KASPER 

t3AUR ICK 


3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



VALIDATION 

Now comes the most critical aspect of any instrument design-- 
the validation. Are the results consistent with what happens in 
real life? 



Great effort was taken to thoroughly analyze the field test 

data and to compare the profiles provided by the instrument with 

those supplied by psychologists and other professionals. The 

validation sample was then checked to see how closely it repre- 
sents the larger field test population. 

At the outset, the content validity of each vignette was 
established by the 19 experts. This assurance is obviously good 
but not enough. Therefore, three separate follow-up studies 
were carried out after the data were returned to verify the ac- 
curacy of the profiles. 

Two of these studies compared the FKSN profiles with diag- 
nostic findings from other professionals and instruments. The 
third checked the interrater agreement, i.e. did several teachers 
exposed to the same population, identify the same kids and agree 
on each child* s potential problems? 



A. SPECIAL SCHOOL FOR THE HANDICAPPED • 

Since kids referred and placed have obviously already been 
extensively diagnosed, b special school for the handicapped is 
an excellent location to validate a screening instrument. None 



of the teachers had fore, 
nette, and therefore, th' 



d- choice responses to make to any vig- 
f names of the kids they identified 
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were written beside vignettes which they felt matched the child's 
V _..»havior . 
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Of the 24 kids from this school, only four had areas of their 
diagnostic profile which differed with the screened profile. 
These differences were directly attributable to two of the 39 
vignettes. Review of these two indicates that only minor re- 
vision is necessary to remove their ambiguity. 

Though nonindependence between areas is not assured, a 
Pearson r Correlation Coef t'icienst seems to be the best measure 
of the relationship between the s;creened profile and the previous 
diagnostic results. The overall correlation between the FKSN 
profiles on these 24 kids and their previous diagnostic results 
was calculated to .89. 

Values for r in each of the ten major' areas of need are 
sho^vn in Figure 1. Using Cohen's Kappa statistic gives basically 
the same results. 



FtGUHE 1. RELATIONSHIP BETWEEN FKSN PROFILES A 

PREVJOUS DIAGNOSES - SPECIAL SCHOOL 

1,0- 
,9 
,8 
.7 
.6 

,5 H 
4 
.3 
.2 
J 
0 



B< REGULAR CLASSROOMS : 

Since many kids in regular classrooms have not been pre- 
viously identified and therefore, have not been diagnosed or 
treated, it was difficult to find existing data to validate their 
profiles- However, since this population of kids is really the 
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only major group to screen (other than to find kids not in school), 
it was imperative that reglilar classroom results be validated. 

Another reason was to see how accurately the regular class- 
room teachers could use the vignettes. It was assumed that they 
may not be as thoroughly familiar with specific children due to 
the larger number of kids they teach nor as tuned in to "abnormal" 
behavior as their colleagues in special schools. Therefore, a 
follow-up study was conducted. 

The population for this validation represents 592 children 
who were identified by FKSN from the 2,151 kids in eight schools. 
These schools were all part of a nine district cooperative which 
had been established to provide special educational services. 

Case files were then reviewed on 98 of these 592 children. 
All of these 98 appeared on both the Cooperative's referral lists 
as well as in the screening results. However, since only 70 
kids had actually been diagnosed by the local psychologists, speech 
therapists, etc., the reports on the remaining 28 children were 
incomplete and therefore unusable for " purposes of the . validation . 

Data were generated by comparing (1) each child's profile as 
described by his psychological reports, teacher comments, achieve- 
ment test results and medical records with (2) the teacher's ob- 
servations as recorded in the screening instrument profile. (Exam- 
ples of the diagnostic tests used by tiiis Cooperative are listed 
in Appendix C. ) 



FfOURC 2, RELATlONSHtP SCTWCEN fKSN PttOFtLES A 

PREViOUS OJAONOSES -ffCOULAff CLASSROOMS 
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By using the same procedures to calculate the Pearson r 
Coefficient on these data as was done on the_special school re- 
sults, it was determined that r=.66 {£=*61, p=.70). Co- 
efficients for each of the ten major categories of need are re- 
ported in Figure 2. These r values are the same when using 
2x2, chi square tables for each area. Kappa values are 
slightly lower. 

As Figure 2 shows, a variance was noted between the screen- 
ing instrument profiles and the diagnostic reports for several 
areas. Looking more closely at the data for the mildly retarded, 
it was found that in some instances, teachers observed retarded 
behavior, and though the psychologists confirmed these low I .Q , 
levels, they recorded their findings as mild or severe SLD problems. 
It is worth noting in this regard, that a shift in the case file 
results appeared during the year that the Cooperative was starting 
SLD programs to meet State mandates for services in this area. 

Another point to note is that since neither the FKSN vali- 
dation sample nor the case files showed any kids with hearing 
problems, a coefficient could not be calculated. However, this 
lack of sample is not surprising in view of the low incidence of 
hard-of -hearing children in regular classrooms. No false posi- 
tives were noted and therefore, the instrument appears to be 
sound in this area. Further testing will be done to verify this 
cone lusion . 

A slight difference was also noticed for withdrawn emotional 
behavior which did not show up as often on the screened profile 
as on the psychologist's reports. Since many of these 70 children 
were diagnosed several years prior to the teacher ^s screening, it 
is not known whether this behavior was absent by the time the 
child was screened or whether the instrument failed to pick up 
as many problems in this area. To be on the safe side, more vig- 
nettes in this portion of the affective domain have been added 
to the next edition. 

C. iNTERRATER AGREEMENT : 

Now for interrater agreement. For this analysis, a junior 
high school was chosen since more than one teacher has the oppor- 
tunity to observe the same kids. In this case, the 105 pupils 
in the 7th grade were screened separately by three different 
teachers . 

Out of this group, 14 students were identified as having one 
or more learning problems. Upon review, it was found that only 
two of these 14 were not listed by all three teachers. When the 
separate profiles for each student were compared across raters, 
the coefficient of agreement was .899. 
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D. ACCURACY- 

As the data in Sections A, B, and C indicate, FKSN accurately 
identities kids with learning problems. Whether there is total 
agreement betvvfjen teacher observations and psychological test re- 
sults in all areas of need for a specific child is another question. 
Unfortunately, statistics do not help us much with the answer. 

This dilemma leads us to an important consideration for these 
or any validation data. All that correlation coefficients show 
is the extent of the relationship between the two profiles. They 
do not attempt to indicate which is most representative of the 
child's actual needs. Therefore, it may be a toss-up trying to 
decide which is the more accurate measure of a child's behavior, 
i.e. (1) tha results from the limited time a psychologist,- coun- 
selor, etc. has to observe a child and test him or (2) the results 
from FKSN which are based on a teacher's daily observations over 
a period of months. 

As reported earlier, the studies by Henig with first grade 
pupils and then by Ilg, Ames and Apell, each lend strong evidence 
to the validity of teacher observations. Further, the longitu- 
dinal study by Keogh and Smith which compared the predictive as- 
pects of the visuo-motor behavior measured by the Bender v/ith 
teacher observations and later achievement scores, drew the 
following conclusion. 

When strength of relationship between kinder- 
garten predictive measures and later school achieve- 
ment was evaluated with Pearson r, teachers' ratings 
had consistently significant correlations with achieve- 
ment measures. Relationships between the Bender at 
kindergarten and later school achievement were generally 
lower and for the most part nonsignificant, especially 
for girls. For girls, only three of 12 possible re- 
lationships between the Bender measures and later reading 
achievement were significant; no relationship with 
arithmetic was significant . -j^g 

The Harth and Glavin study also supports the accuracy of 
classroom teacher ratings. In this case, the findings show that 
these observations serve as '*a valid screening technique for 
emotionally disturbed students". 

It stands to reason that any person from outside the class- 
room who has been asked to diagnose a child has at best a few 
hours to a few days to elicit the behavior in question. Because 
of this time limitation, much reliance must be given to the re- 
sults from instruments which confound the child's test-taking 
ability with his actual behavior. 

This time limitation may also explain why the coefficients 
for the regular classrooms are lower than the ones from the 
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special school. In the latter case, the specialists had much 
more contact with the children and consequently their conclusions 
were closer to those observed by the teachers. 

This is not to suggest that much more indepth diagnoses are 
not possible for specific behavioral areas when done by outside 
professionals. However, it seems that a strong case has been 
made for the predictive validity oX a classroom teacher's ob- 
servations. Given an in st rumen t to guide her thinking, she pro- 
bably has more information on which to draw over a longer period 
than any other method of synthesis. 

Another point to remember is that in the first round, it 
is extremely important to find kids who need help. If later 
diagnoses turn up additional problem areas in a child, so much 
the better for having gotten the child the initial help. 

So, how effective was FKSN at finding learning problems? 
Well, if the number of areas identified by the outside professional 
tor each grade level is compared with the number of areas picked 
up by FKSN, then the correlation coefficient is .97. This means 
that FKSN not only finds the kids referred but indicates at least 
as many potential problem areas as the professional diagnoses. 
Et is also apparent that FKSN was much more effective than the 
referral system in use since the learning problems of 480 kids 
in these eight schools had not yet been referred. 

Coefficients similar to those shown in Figure 2 have now 
been reported from an independent validation study involving 
115 kids in still another of the five field-test states. The 
relationship between the number of kids on the referral lists 
for these schools and the FKSN totals are also similar to the 
eight schools reported above. 

E. REPRESENTATIVE SAMPLE ■ 

Before we leave the validation data, one impoL'Lant question 
still needs to be answered for statistical purposes. That is, 
how representative is the validation sample (N=144) of the larger 
field-test population (N=10,351)? 

Using a 2 x 10, chi square analysis shows no significant 
difference between these two ( = 11.23). However, doing 
individual t-tests on each area turns up slight differences in 
the Gifted, SLD, and Speech categories. 

Knowing how the validation sample was selected helps inter- 
pret these differences. First, since the profiles were matched 
to diagnostic case files, the lower number of gifted kids in the 
sample is not surprising. Unless the gifted had some learning 
problems, they would not be referred. Secondly, the SLD increase 
is probably due in part to the effort to fill SLD programs to 
meet the legislative mandate. Finally, the decreased number of 
speech cases is likely due to a good speech program in this coop- 
erative and a more middle-class, homogeneous student population. 



Many of the schools in the Jnrger field test included inner city 
schools which showed n higher proportion oi speech problems in 
general , 



FIGURE 3. HOW REPnESEUTATIVE 

WAS THE SAMPLE 7 




■^A significant difference (p=.05) was noted between 
the validation sample and the field-test population 
for the Gifted, SLD, and Speech areas of need. 



From these analyses, it seems fair to conclude that the 
sample is basically representative of the field-test population 
and that this population is representative of the schools in 
most states. Inferences to the outcome of similar screening 
efforts appear to be appropriate. 

DISCUSSION 

A. "just for starters" 

Now comes some important questions to be asked of any research. 
What difference does it make? How can the findings be used to im- 
prove education? In this case> the reverse can also be asked. 
What does it cost not to use FKSN to facilitate district, inter- 
mediate and state level planning? 



Looking closer at this last question brings us back to why 
."is instrument was designed to start with. If a child* s learning 



-24- 



problems have to become acute berore he stands out enough to be 
referred, then we do a great disservice to the child and end up 
spending more tax money to help him than would have been spent 
if the problems were noted earlier. 

Being more acute, this child's behavior takes longer to 
modify, ties up more district resources and therefore, prohibits 
other kids from receiving the services they need. Both monetary 
and human waste are involved. 

For the child who doesn't stand out, we arc faced with a 
case similar to many kids who '*slide-through'* and "drop-out". 
Frustrated in the effort to achieve their potential, they cost 
society more as under-employed, unemployed, welfare recipients 
or criminals than they would have otherwise. 

Granted, this is not always true, but enough so that we 
educators need to improve the system. Most of us reali;ie its 
shortcomings. V^/e also acknowledge the fact that knowing which 
kids have problems doesn't mean that we have the money or methods 
necessary to help all of the kids who need it. Knowing, however, 
does give us a start. 

What FKSN does is fill the g.ip between the kids who have 
made it through the referral process and the actual numbr^r of 
kids who need special resources. Also, since confidentiality 
is built in and teachers do not label their kids, these con- 
cerns are reduced. 

By having comprehensive profiles of the learning problems 
of individual children, district personnel should be freed to 
spend much more time developing and implementing treatment stra- 
tegies. Consequently, greater effort can be spent working with 
the comparatively few kids with severe problems in any school. 
(For example, only 9% of the 10,351 problem areas identified 
in the 6,448 kids were considered severe.) 

It boils down to the fact tljat professionals with special 
competencies are needed by school districts. However, as things 
presently stand, the referral system wastes their special skills 
by forcing them to spend too much of their effort being psycho- 
metric technicians. They have also been asked to concentrate on 
testing fcr placement rather than using their diagnostic techniques 
as an integral part of regular classroom and home treatment stra- 
tegies. Consequently, the time they have left over to help alle- 
viate the learning problems of children is significantly reduced. 

B. ALTERNATIVES: 

A major point of this discussion is that FKSN will find kids, 
but once identified, some changes in philosophy may be required 
to get needed services to them. Developing a long-range strategy 
is essential. Designing neiv ways to make better use of existing 
budget and staff competencies may al so be needed. 
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Mn i ntcii n i ruj special cl£\ssrooins is expensive. On the other 
hand, regular classroom teachers could handle a child's problem 
i.i its early stages with just a little support or extra training. 
Ir. service may be enough for the latter. As for support, actually 
providing treatment, helping with small group activities, and 
working w ith the regular teacher makes a lot of sense. 

We have to get awav from the idea that a child "belongs" 
to ^^ specific educator. Obviously, not every teacher or classroom 
has all the resources needed for every learning situation. There- 
fore, district specialists could facilitate efforts to get services 
to the identified children by helping the classroom teacher find, 
coordinate and implement spec^^al resources be they books, films, 
glasses, a hearing aid, neurological exam, or a self-paced learning 
machine. District personnel working as a team for children are 
bound to be more effective than a policy which expects one teacher 
to handle the total needs of every child in her classroom. 

C. WHAT FKSN CAN DO FOR KIDS ' 

By using KKSN, not only should more kids get the services 
they need, but budgeting and long range planning should also 
be greatly enhanced. Obviously, services cannot be provided the 
ft)l lowing year to all kids identified. However, a comprehensive 
plan of actif)n can be developed which looks at various alterna- 
tives for differential staffing, inservice training, facility 
utilization and funding. 

Further, by providing names to district personnel rather 
than numbers, follow-up services to many of the identified kids 
can be started immediately. Adding the names of kids known to 
be in nonschool facilities or who are receiving no educational 
services at all. completes the list of kids for whom the schools 
should be planrjing. Specific staff personnel can then be assigned 
to each child with the responsibility to see that treatment and 
evaluation is received. 

For the intermediate and state level, FXSN should be an 
exceptionally effective way to stimulate district planning while 
incorporating meaningful assistance for these two upper levels. 
As an example, legislative and funding proposals can be based 
on a much more accurate view of just what problems need to be 
dealt with. Priorities can be established, training programs 
developed, facilities better utilized and in the long run, lower 
^osts should be realized through more effective, early intervention. 

Other important considerations include the fact that FKSN 
is comparatively inexpensive to administer. It also takes a 
teacher 25 minutes or less to screen her whole class. Kids can 
be absent the day of the screening (as is too often a problem 
with group administered testing) and still have their needs 
identified. The data are easily coded for confidentiality and 
future use- Batch processing also keeps costs down and permits 
multiple district or state-wide data analysis. 
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PRESENT STATUS of FKSN 



A tiiorough item ancilysis has been completed on the field- 
test version of KKSN , A few of the ambiguously worded vignettes 
have been revised and the instructions improved. The coding 
procc^dures and data sheets have also been simplified even further. 
The second edition of PKSN is being printed and will soon be 
ava i ] able. 

Many supplemental analyses of the field-test data have also 
been run. However, for the sake of brevity, these findings have 
not been included in this report. 

Suffice it to say that some striking similarities and dif- 
ferences have come out of the comparison of FKSN incidence 
figures and the national incidence figures which suggest that 
the iN'IF underestimate certain categories of need. Other evidence 
indicates that the longer a child waits for services, the more 
likely he will have secondary handicaps which complicate his 
primary learning problems. As for speech, this area drops from 
2^ul% of the learning problems of kindergarten and first grade 
kids to 6.}% of the 5th and 6th grade learning problems. These 
rindings are supported by the research of Carr and Stover and 
lend further weight to the validity of FKSN as a screening instru- 
ment . _ 



In addition to being able to supply the instrument and these 
research supplements, we are set up to handle large-scale data 
processing demands and to help any district, intermediate unit, 
or state department with its screening efforts. We have the ex- 
perience, interest and desire to be of service, so give us a call 
or write for further information. 



£>r Walt ChappeU 

President 

RESOURCE MANAGEMENT SYSTEMS, INC. 
EO. BOX 5518 CARMEL, CA. 93921 
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APreNDIX A. SCREENING INSTRUMENTS IN PRINT 
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Adjective Check List Crpiitlvity Scale 

Agnression, Mc^odiness, Learning Disabilities Behavior 
Reiting SCfilo 

A Manual for Classroom Teachers: How to Recognise and 
Help Children with Mental Emotional Disorders 

:\ Program for Early Identification of Learning Disabilities 

Behavioral Aspects of Learning Disabilities: Assessment 
and J^emediat i <.in 

Bower- Lambert Early Identification of Emotionally Handi- 
capped Children Fundamental Interpersonal Relations 
Orientation-Behavior (Children's) Scales 

Denver Articulation Screening Exam 

Denver Developmental Screening Test 

Developmental Screening Instrument 

Deveroux Elementary School Behavior Rating Scale 

Elementary School Adjustment Scale 

Goldman-Fri stoe-Woodcock Tests of Auditc^ry Discrimination 

Gottschal k-Gleser Content Analysis Scales: Anxiety, Hos- 
tility, Social Alienation, and Personal Di sorgani ;2at ion 

Jansky Predictive Index for Reading 

Louisville Behavior Check List 

Mc Dona Id- Deep Test of Articulation 

Metropolitan Readiness Test 

Ottawa School Behavior Su rvey 

Peterson-Quay Behavior Problem Check List 

Predictive Screening Test of Articulation 

Teachers Adjective Check List 

Teachers Behavior Rating Scale 

Templin-Da rley Screening and Diagnostic Test of Articulation 
The Pupil Rating Scale: Screening for Learning Disabilities 
"What Kind of Person Are You?" 



APPENDIX B. SAMPLE VIGNETTES FROM FKSN 



Jane can read material which is about five grade levels 
above her class; however ^ her handwriting is poor and she 
is about average-to-above in most other subjects. 

Stella's speech is laboriously slow, tortured^ jerky and 
indistinct: her voicp is monotonous in pitch and she cannot 
Control its intensity. 

Bill has no difticulty on the playground or at the blackboard 
but he gets quite uncomfortable when he has to use his eyes 
at close range for any length of time. 

Every hour or so Alfred stares upwards at the ceiling for 
several seconds and loses consciousness; he has been like 
this for several years but is otherwise developing normally. 

Bert doesn't seem to catch on to things as quickly as most, 
and needs to have things explained over and over again; 
eventually even though it takes longer, he appears to learn 
everything the other kids do, 

Henry is defiant and stubborn, likely to argue with the 
tecicher, be wilfully disobedient, and otherwise interfere 
with normal classroom discipline. 

Sue has been placed in the lower reading group and has 
trouble with recognizing or decoding words even at that 
level, 

John can't hear anything with his left ear, but he gets 
along fairly well if he can sit by the window, on the quiet 
side of the building, with the class to his right. 

Chuck could play songs with one finger on the piano when 
he was four. Now he has begun composing little melodies 
to which he gives names like "I^ainy Day", "Bert's Bike", 
or "Juice-Time", 

Earl sulks, and sometimes gets quite noisy, whenever he 
loses the direct attention of the teacher. 



APPENDIX C. DIAGNOSTIC INSTRUMENTS USED BY THE 
SPECIAL EDUCATION COOPERATIVE 



1) Bender Visual Motor Gestalt Test 

2) Draw-a- Person 

3) Frostig Developmental Test of Visual Perception 

4) Human Figure Drawing 

5) Illinois Test of Psycholinguistic Abilities 

6) Key Math Diagnostic Test 

7) Peabody Picture Vocabulary Tes^ 

8) Rorschach Inkblots 

9) Silvaroli Classroom Reading Inventory 

10) Thematic Apperception Test 

11) Wechslcr Intelligence Scale for Children Test 

12) Wide Range Abilities Test 
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